(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 




(19) World Intellectual Property Organization 

International Bureau 

(43) International Publication Date (10) International Publication Number 

1 March 2001 (01.03.2001) P CT WO 01/15423 Al 



(51) International Patent Classification 7 : H04M 11/00, 

1/64 

(21) International Application Number: PCT/US00/23280 

(22) International Filing Date: 24 August 2000 (24.08.2000) 



(25) Filing Language: 

(26) Publication Language: 



English 
English 



(30) Priority Data: 

09/382,006 



24 August 1999 (24.08. 1999) US 



(71) Applicant: GTE LABORATORIES INCORPORATED 

[US/US]; 1209 Orange Street, Wilmington, DE 19801 
(US). 

(72) Inventors: BROPHY, Kevin; 476 Crescent Street, Brock- 
ton, MA 02302-3218 (US). CHOW, Anita; 15 Appletree 
Green, Nashua, NH 03062-2252 (US). HAHN, Mark; 35 
Dunster Drive, Stow, MA 01775 (US). LEJTER, Luis; 
370 Ocean Avenue, Apartment 403, Revere, MA 02151 
(US). ROBBINS, David; 92 George Hill Road, Grafton, 



MA 01519 (US). SCHETTINO, John; 1310 NW Whit- 
man Court, Camas, WA 98607-8406 (US). 

(74) Agent: SUCHYTA, Leonard, Charles; GTE Service 
Corporation, 600 Hidden Ridge, HQE03G13, Irving, TX 
75038 (US). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CR, CU, CZ, 
DE, DK, DM, DZ, EE, ES, FI, GB, GD, GE, GH, GM, HR, 
HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, 
LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, MX, MZ, 
NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, SL, TJ, TM, 
TR, TT, TZ, UA, UG, UZ, VN, YU, ZA, ZW 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, 
IT, LU, MC, NL, PT, SE), OAPI patent (BF, BJ, CF, CG, 
CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG). 

Published: 

— With international search report. 

[ Continued on next page ] 



(54) Title: SYSTEMS AND METHODS FOR PROVIDING UNIFIED MULTIMEDIA COMMUNICATION SERVICES 



r 



10 





aoo 

C30Q 

aoo 



26 



7 



24 



t_3 



XT 



22 



D 



S .... X 



O 



LAN 
MODEM 
ADSL/CABLE 
WIRELESS DATA 




12 



GTE 

INTEGRATED 
SERVICES 
PLATFORM 



(57) Abstract: The systems and methods described herein include a platform (12) that employs a client/server architecture to provide 
an extensible set of real time and messaging communication services to a plurality of users. The platform (12) allows the clients 
to configure and activate the services as each user wishes, thereby providing individual control over the communication services 
a user receives. The platform (12) includes a server (15, 18, 30, 32, 34, 42A-42E, 90, 92) that allows a user to select how the 
user will participate in a communications event. This can include control over the end points (48, 50) and media over which the 
communications event occurs. The systems described herein additionally provide a framework for developing integrated voice and 
data services that can be deployed on the platform (12) for extending the services available to the plurality of clients. 
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SYSTEMS AND METHODS FOR PROVIDING UNIFIED 
MULTIMEDIA COMMUNICATION SERVICES 

Technical Field 

5 This application generally relates to communication systems, and more 

specifically to communication systems that include systems that allow a user to 
control how they participate in a communications event, including how they receive 
and send multimedia content. 

1 0 Background Art 

Today there is an ever increasing demand for providing communication 
services that integrate both voice services, such as telephone calls, voice mail, and 
interactive voice response, with data services such as e-mail and personal 
information management. This desire for integrated voice and data services has 

15 driven the development of new telecommunication platforms that can handle voice 
and data being carried on both circuit switched and packet switched networks. 
These platforms can operate on digitized voice as well as conventional computer 
data to provide integrated services that allow customers to perform more 
sophisticated telecommunication techniques. For example, such systems can 

20 perform adaptive call forwarding, wherein a computer program responding to 
information carried on the packet switched network can adaptively forward a 
telephone call to predetermined customer premises equipment (CPE) according to a 
predetermined schedule that has been programmed into the platform. Such 
integrated voice and data services provide more powerful functions for allowing 

25 customers to communicate with each other. 

Such integrated systems also facilitate communications events that are more 
complex than traditional voice calls and voice mail. For example, communications 
events today can employ multimedia data formats, involve the coordinated delivery 
of text, audio and video, and even extend across multiple different CPEs, such as 

30 handsets, workstations and personal digital assistants. Thus, although these new 
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types of communications events provide powerful ways to exchange information, 
they are too complex to be serviced efficiently by traditional platforms and models 
for handling calls. 

In particular, existing systems for allowing integrated voice and data 
5 services, and multimedia communications typically require each user to interact with 
the communications event in a predefined, or narrowly defined way, providing 
limited ability for the user to control how a call, or communications event will be 
received and handled, and providing little opportunity for extending the services that 
can be provided to a user. Additionally, existing systems, although capable of 
10 handling voice and data events, often provide limited coordination of real time and 
messaging communications events. Thus, existing systems tie users to particular 
devices and services, and fail to provide a user with a facile way to manage the 
services and equipment that are available to the user for handling a communications 
event. 

15 Accordingly, there is a need to provide communications systems that provide 

a user with greater control over a communications event and that are more readily 
extended and scaled. 

There is a further need for systems that provide a user with increased control 
over the systems and devices that can be employed during a communications event, 
20 including providing systems that give control over the media formats of a 
communications event. 

There is still a further need to provide systems that more seamlessly integrate 
real-time communications events with messaging events. 

25 Disclosure of Invention 

The systems and methods described herein include a platform that employs a 
client/server architecture to provide an extensible set of real time and messaging 
communication services to a plurality of users. To this end, the platform architecture 
provides a customer centric model for processing a communications event, thus 
30 allowing a customer to control how the customer participates in a communications 
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event. The platform allows the customer to configure and activate the services, 
thereby providing individual control over the communication services a customer 
receives. The platform includes a media server that interfaces to a circuit-switched 
network, such as the PSTN, as well as to a packet switched network, such as the 
5 Internet, to provide audio, video, and data communication services. The platform 
further includes an application server that acts as a client to the media server, and 
that coordinates a plurality of session processes, each of which can be associated 
with a particular customer. It will be seen that the systems described herein also 
provide a framework for developing communication services that can be deployed 

10 on the platform for extending the services available to a customer. 

More particularly, the systems include an extensible client/server system for 
enabling the development of audio, video and data communication services. These 
systems comprise a media server for controlling hardware devices that interface 
communication networks, such as the public switched telephone network. The 

15 media server provides a plurality of resource objects each having a method and a 
data structure for controlling a hardware device to perform a communication 
function, and an object oriented client interface for organizing the objects into a set 
of application-level components for performing a communication operation. The 
system can further include an application server having an application framework 

20 that incorporates the resource objects to provide an extensible mechanism for 
interacting with communication operations being implemented on the hardware 
device. 

More particularly, the system provides in one aspect methods for allowing a 
customer to control their participation in a communications event. These methods 

25 can comprise the steps of identifying a communications event that is associated with 
the customer, providing for that customer a session object capable of maintaining 
state information that is representative of the state of the customer's communications 
events as well as being representative of control information provided by that 
specific customer; and providing a plurality of service objects, each being capable of 

30 providing a communications service for supporting the communications event, and 
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each being responsive to the state information maintained within the session object. 
Accordingly, the session object operates as a control point for accessing the service 
objects and thereby for allowing the customer to configure selectively the support for 
the communications event the customer wishes. Moreover, as the session object 
5 maintains state information that the customer can alter, the customer is therefore 
provided with the opportunity to change state information during a communications 
event, thereby allowing the customer to change, even dynamically, how they 
participate in the communications event. For example, if the session object 
maintains state information that indicates that the customer wishes to receive 

10 telephone calls over a traditional handset, by changing the state information to 

change the end points employed (i.e., also known as resetting the control leg), the 
customer can now request that an ongoing telephone call be switched to a 
multimedia workstation, without interrupting the call. In a further practice, the state 
information can be employed by the system for modifying the behavior of two or 

15 more service objects to provide coordinated operation of the service objects. In this 
way, the state information can be employed to allow service objects to cooperate in 
providing services to the customer. 

In a further practice, the methods of the invention include the steps of 
providing a customer profile object that has information which is representative of 

20 certain characteristics associated with a respective customer. These characteristics 
can include information that is representative of customer preferences which may be 
used to modify the behavior of the service objects. Customer preferences include, 
for example, the number of times the customer wishes a phone to ring before a call is 
transferred to voice mail, as well as other similar customer preferences. 

25 The methods described herein also include providing a communications 

infrastructure for mapping calls associated with a customer to a communications 
structure that is capable of processing communication information associated with 
the calls. In this practice, a media server may be provided that has a plurality of 
resource objects, each of which is capable of allowing the service object to control a 

30 communication device that is capable of supporting the call. Communication 



WO 01/15423 



PCT/US00/23280 



5 

devices include telephone handsets, multimedia PC's, PBX systems, or any hardware 
or software communication device. The communications infrastructure can include 
a control leg object that is capable of mapping a call to a set of resource objects that 
may control a communication device, such as a telephone, to provide therefore a 
5 media pathway for coupling the customer to the call. The media pathway can be an 
audio pathway, a video pathway, a data pathway, a multimedia pathway or any 
pathway suitable for supporting the application at hand. 

In one embodiment, the invention will be understood to provide methods that 
allow the system to access a set of resource objects that map the call to a plurality of 
10 different communication devices for providing a virtual multimedia communication 
terminal. Accordingly, the systems and methods described herein are hardware and 
software communication device independent, allowing a customer to leverage their 
already existing communication devices to provide high-level communication 
functionality. 

15 In a further optional practice, the state information may be employed to 

identify a set of resource objects that map the call to a communication device 
selected by the customer. In a further alternative practice, the methods described 
herein provide a communications infrastructure that includes a call management 
object for mapping a call to a set of resource objects capable of offering the call as a 

20 member of a set of calls available to the customer. The communication 

infrastructure can further provide an incoming call agent that is capable of 
processing the state information of a session object to determine whether to attach a 
call to a call management object, to transfer the call to a predetermined location or 
device, to query the customer on how to handle the call or to block the call. 

25 Additionally, the communication infrastructure can also include a call recorder 

agent, capable of processing one or more media streams associated with the call and 
packaging the media stream or streams into an e-mail message for delivery to a 
mailbox associated with a customer. Additionally, the communication infrastructure 
can include a media translation agent capable of supporting cross-media translation, 
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including real-time cross media translation, to translate a media stream associated 
with a call from a first format to a second format. 

In a further practice, the methods described herein allow a customer to create 
a connection object that is capable of allowing the customer to interact with the 
5 session object. The connection object provides a channel object that is capable of 
acting as a media pathway between a communication device employed by the 
customer and the service object. In this way, the customer can interact through the 
channel object with the service object, which can be an interactive voice service. 

In a further aspect, the invention will be understood as systems for allowing a 

10 customer to control their participation in a communications event. These systems 
comprise a media server that has a plurality of resource objects, each being capable 
of providing control over a communication device, and an application server for 
supporting a communication application, having a service object capable of 
interfacing with the resource objects and connecting the resource objects into a 

15 structure for supporting the communications event. Accordingly, it will be 

understood that the systems described herein are extensible in that new services are 
readily added into the system and connected together to provide new communication 
services for the customers. 



20 Brief Description of Drawings 

Figure 1 depicts one system according to the invention; 
Figure 2 depicts in greater detail a service platform such as that depicted in 
Figure 1; 

Figure 3 depicts in more detail the media servers that can couple to the 
25 platform of Figure 2; 

Figure 4 depicts graphically the connecting of resource objects for forming a 
communication pathway; 

Figure 5 depicts graphically the connecting of resource objects for forming a 
communication pathway between a plurality of calls; 
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Figure 6 depicts graphically the connecting of resource objects to form a 
communication pathway that includes a path to a call recorder agent; 

Figure 7 depicts graphically the connecting of resource objects to form a 
communication pathway between a voice device and a data device; 
5 Figure 8 depicts graphically the connecting of resource objects to provide a 

communication pathway to an interactive voice response service; 

Figure 9 depicts graphically an application server coupled to a plurality of 
message servers; 

Figure 10 depicts graphically an application server coupled to information 
10 servers; 

Figure 11 depicts an infrastructure that represents a view of the state of a 
customer's communications; 

Figure 12 depicts in more detail the objects that comprise an application 
suitable for running on the platform of Figure 2; 
15 Figure 13 depicts in more detail the channel connections between an 

application and a customer; 

Figure 14 depicts in greater detail the objects that can comprise an 
application in the context of a unified multimedia communications platform; and 

Figure 15 depicts one process according to the invention for configuring a 
20 server, such as the server depicted in Figure 14. 

Best Mode for Carrying Out the Invention 

The integration of computer and telephony services requires a platform that 
is capable of handling communications events that can occur in various media 

25 formats and over various communication channels. As communication technology 
continues to evolve, flexible and extendible platforms will be necessary for 
supporting the more complex communications events in which customers will soon 
be able to participate. However, conventional service platforms, even those intended 
to integrate computer technologies and communication capabilities, are typically 

30 built around a communication model wherein a call is an event in which a person 
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must participate. This call-centered view of communications vests the call with 
control over the communications event and generally dictates to the customer how 
the customer should participate in the call. As will be seen from the following, the 
systems and methods described herein employ an alternative model, allowing a 
5 person who wants to be able to control a communications event or many different 
communications events to be able to extend the type of control the customer has 
over the communications event. To this end, the systems and methods described 
herein take a customer-centered approach for providing a communications platform. 
Thus, the communication platforms of the invention allow the customers access to 

10 services as they choose using a variety of customer premises equipment (CPE), 
including wireline/wireless phones, personal computers and personal digital 
assistants (PDAs). 

The flexibility of the architecture of the systems and methods described 
herein is depicted pictorially in Fig. 1. Specifically, Fig. 1 shows a system 10 that 

15 includes an integrated service platform (ISP) 12 that couples to a circuit switched 

network 14, such as the public switching telephone network (PSTN), which couples 
to communication devices, such as depicted CPE 18 and 20. Similarly, Fig. 1 
depicts that a packet switched network 16, such as the Internet, can couple to the ISP 
12 thereby providing a connection for the data communication devices, such as the 

20 illustrated workstation 22, video phone 24, and PDA device 26. The data 

communication devices 22, 24 and 26 can couple to the Internet through any suitable 
communication pathway, such as a local area network (LAN), modem connection, 
digital subscriber loop (DSL), cable connection, or wireless connection. It can be 
seen from a review of Fig. 1, that the ISP 12 sits between the circuit switched 

25 network 14 and the packet switched network 16. The ISP 12 thus allows a customer 
to have integrated control over various communications events that are to be 
serviced by the platform 12. A communications event can be any type of event or 
occurrence that involves the delivery of information between parties, or between the 
same party. Communications events can be considered either real-time events or 

30 messaging events. Real-time communications events can include calls over the 
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PSTN, IP network, or a combination of both, and can include multiple party 
conference calls, which are audio, video, data or multimedia. Examples of 
messaging events can include email, file transfers, documents delivered by push 
systems, or any other suitable event. Messaging events can carry information in any 
5 format, including text, audio, video, alone and in combination. 

The integrated control provided by the systems and methods of the invention 
enhances the way customers communicate with other individuals/groups. It will be 
understood herein that a customer can be any person, business or entity that can be 
identified as a party having an interest in a communications event. For example, 

10 under certain circumstances a conference room can be deemed to be a customer, as 
the individuals in the conference room may wish that conference room exert some 
control over how a conference call event is handled. For example, the conference 
room can determine whether any incoming calls that arrive to the conference room 
are to be joined to the conference call event. As will be seen from the following, the 

15 ISP 12 can provide a set of services that seamlessly integrate personal mobility, 

multimedia call management, and unified messaging. As a result, such ISPs provide 
an extendible, robust platform for next-generation communications 
network/services. 

A high-level overview of the architecture of one embodiment of an ISP 
20 according to the invention is shown in Fig. 2. More particularly, Fig. 2 shows that 
the ISP 12 can include an application server 15, media servers 34, message servers 
30, and information servers 32. The media servers 34 and the message servers 30 
act as communication building blocks that can be employed by services executing on 
the application server 15 to create communication pathways for carrying data 
25 between end points. The information server 32 can act as an information building 
block that can provide to services running on the application server 15 information 
that may be required by a service to control or perform a communications event as 
requested or directed by a customer. 

The application server 15 is at the center of the ISP Architecture, acting as 
30 the "brain" of the system by coordinating how the other components work together 
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to form integrated communications/information services. In one embodiment, the 
application server 15 consists of an object-oriented framework designed to simplify 
the creation of services that integrate the capabilities and resources of the 
surrounding building blocks to perform tasks on behalf of a customer. Each service 
5 executes within the context of a session, which supports the sharing of data between 
the services and helps coordinate their activities. A profile object provides the 
preferences and personal information used to customize the behavior of the session 
and services for a particular customer. 

Although the application server 15 can comprise an object oriented 

10 framework, it will be understood by those of ordinary skill in the art that structures 
alternative to object oriented frameworks can be employed for implementing the 
application server. However, for purposes of illustrating the systems of the 
invention, the application server 15 will be described with reference to an 
application server that employs an object oriented framework. As is known to those 

15 of skill in the art, object oriented frameworks are generally understood as a set of 
classes that embody an abstract design for solutions to a family of related problems. 
See The C+ + Programming Language, 2nd Ed., Stroustrup Addision-Wesley. 
Accordingly, a framework provides a prefabricated structure, or template, of a 
working program. For example, for a traditional application program, a framework 

20 can provide support and "default" behavior for drawing windows, scroll bars and 
menus. Optionally, a framework can provide sufficient functionality and wired-in 
interconnections between object classes to provide an infrastructure for a developer 
developing services for the ISP 12. The interconnections are generally understood to 
provide the architectural model and design for developers, allowing developers to 

25 focus on the problem domain and allowing increased levels of hardware 

independence, as frameworks can provide to developers abstractions of common 
communication devices reducing the need to include within a service application 
hardware dependent code. 

The design and development of object oriented frameworks, such as the 

30 framework that comprises the application server 1 5 described herein follows from 
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principles known in the art of computer science, such as principles set forth in 
Booch, Grady, "Designing an Application Framework". Dr. Dobb's Journal 19, No. 
2, (February, 1994); Booch, Grady, "Object Oriented Analysis and Design With 
Applications", Redwood City, CA. Benjamin/Cummings (1994); and Taligent, 
5 "Building Object Oriented Frameworks", Taligent, Inc., (1994). It will further be 
understood by those of ordinary skill in the art that although Fig. 2 depicts the 
application server 1 5 in functional block form, the depicted elements can be realized 
as software processes executing on a data processing platform, such as a SUN 
workstation, manufactured and sold by SUN, Inc. of Mountain View, California, 

10 running the Unix operating system. Additionally, the functional blocks depicted 

herein can also be realized as hardware devices, as well as devices that include both 
hardware and software for operating as described. 

It will further be understood that the systems of the invention can be 
standalone computing devices that can interconnect and communicate with external 

15 communication devices such as PBX systems, routers, and other communication 
devices. Alternatively, the systems of the invention can be incorporated into 
communication devices such as PBX systems, multimedia data processing platforms, 
or any other suitable communication device. Accordingly, it will be understood that 
the systems and methods described herein can be modified, extended, or integrated 

20 into prior art communication devices by those of ordinary skill in the art without 
departing from the scope of the invention. 

The depicted ISP 12, as shown is Fig. 3, supports real-time multimedia 
communications, such as calls consisting of one or more media types. For example, 
the ISP 12 can define media types to support calls consisting of audio data, video 

25 data, text-based chat, white boards and shared applications. Other media types can 
also be defined. Each media type can be supported by a corresponding media server 
42A-E. Each media server 42A-E can act to establish a communications pathway 
between one or more end-points in a manner that is appropriate for that media. For 
example, to complete an audio pathway between a standard phone and an IP 

30 Telephony client on a PC, the audio server 42A can be responsible for allocating a 
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port on an IP-PSTN gateway and establishing the necessary connections from the 
gateway to the different network end-points. 

In one embodiment, the application server 15 can employ a Media Server 
Client Interface 40 (MSCI) to communicate with the media servers 42A-E. The 
5 MSCI 40 can be an object-oriented programming interface that allows client 

applications, such as the application server 15, to interact with the media servers 
42A-E using an abstract connection model to specify and establish a media pathway. 
Each media server 42A-E can be capable of implementing the objects defined by the 
MSCI 40 and for mapping the set of logical connections between the objects into a 

10 set of physical connections between corresponding media end-points. Accordingly, 
a service can request the appropriate media server to provide certain functionality, 
such as connecting the customer to an incoming phone call, and the media server 
will map the requested service onto the physical devices necessary for achieving that 
function. Thus, the media servers 42A-E are understood to include the hardware 

15 specific control software capable of controlling the hardware devices associated with 
that particular media server for causing the hardware devices to act in a manner that 
provides the service requested by the customer. The development of such hardware 
specific control software follows from principles well known in the art of computer 
science and embedded system development. 

20 In one embodiment, to provide control over the resources of the media 

servers 42A-E, the MSCI 40 can define two object types: registration and resource 
object types. A registration object allows an application to specify interest in an 
asynchronous event, such as an incoming call or hang-up event. A resource object is 
a logical element, corresponding to one or more physical units, designed to perform 

25 a specific function, such as manage a call end-point, or record a media stream. A 

service can connect the resource objects together in order to create a media pathway 
and perform various operations. 

To this end, the resource objects can include a call resource that represents an 
incoming or outgoing call. In general, a call resource object corresponds to the media 

30 server's media channel to a media-specific client, such as a PSTN phone, or an IP 
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audio/video application. Fig. 4 illustrates a mapping produced by the audio server 
42 A when two call resources are connected together. Specifically, Fig. 4 depicts 
pictorially the logical connections and the physical mapping associated with the 
logical connections. Fig. 4 depicts two end points to a communications event, 
5 shown in Fig. 4 as a handset 48 and a workstation 50. Two call resource objects 52 
and 54 connect between the end points 48 and 50 for providing a communication 
pathway therebetween. The call resource objects 52 and 54 are abstractions exported 
by the media servers, in this case the audio server 42A, that can be connected by a 
service to provide a communication pathway between the handset 48 and the 

10 depicted workstation 50. As also shown by Fig. 4, a physical mapping can occur 
between the handset 48 and the workstation 50 wherein the interconnected call 
resource objects 52 and 54 are realized as a gateway 58 that couples between a 
packet switched network, such as the depicted IP network from the workstation 50 
and the circuit switched network such as the PSTN that would couple to the handset 

15 48. The gateway 58 can be an audio bridge of the type commonly employed for 

mediating between Internet telephony and circuit switched telephony events. Such 
gateways are available commercially, sold for example by Lucent Technologies of 
Murray Hill, N.J., however, any suitable gateway can be employed. Note that from a 
service developer's perspective, the call resources are abstract objects and are, 

20 therefore, network-independent. This relieves the service developer from having to 
provide this functionality, and makes the service platform independent. 

Figs. 5 through 8 illustrate generally other examples of resource objects that 
can be provided by the media servers 42A-42D for allowing a service object to 
connect different communication devices into a desired media pathway. For 

25 example, a connection point 70 can be provided to connect a group of resources 
together. Fig. 5, depicts how a connection point 70 can be used to create a 
multi-party- conference call. Each media server decides how to implement the 
resulting conference. For example, the audio server 42A may choose to use 
switch-based conferencing hardware, depending on the nature of the calls, while the 

30 Video server 42B may use IP multicast exclusively. 



WO 01/15423 



PCT/US00/23280 



14 

A recorder resource 72 can be used to record the media stream within a 
call/conference. It can also be used to playback a recorded media file. In Fig. 6, a 
service, called the call recorder agent, described later, is implemented using such a 
recorder resource 72. 

5 In addition, the MSCI 40 can define an optional converter resource, which 

can be employed to transform a media stream into another form/media. For example, 
the audio server 42A provides a resource which supports 
speech-to-text/text-to-speech conversion. In Fig. 7, a converter resource 78 is 
depicted from both the audio server 42A and the chat server 42C to perform 

10 real-time, cross-media translation. 

Additionally, each media server may provide additional, media-specific 
functions to application developers. For example, the audio server 42 A can define a 
voice resource 80 to provide a set of functions, such as play prompts and collect 
DTMF digits, to support development of interactive voice response (IVR) services, 

15 as shown in Fig. 8. 

The ISP 15 can support different types of advanced communications services, 
including real-time multimedia communications. The systems described herein 
provide the ability to support services that integrate and extend asynchronous 
communications, or messaging. To integrate these real-time communications with 

20 messaging, the ISP can employ a standard e-mail server (depicted as "ISP Server 90" 
in Fig. 9) to store messages. For example, voice mail can be stored as an e-mail 
message containing a Multipurpose Internet Mail Extension (MIME) encoded audio 
attachment, and later the messages can be retrieved using a standard e-mail client. 
Optionally, a Message Interface Application Programming Interface (API) 

25 can be provided to allow service developers to compose/send messages using a mail 
protocol, like the Simple Mail Transfer Protocol (SMTP) and to retrieve messages 
from the message servers using a client/server messaging protocol such as Post 
Office Protocol (POP3) or Internet Message Access Protocol (IMAP4). Since the 
Message Interface can be standards-based, it will be understood that ISP customers 

30 can use a publicly accessible e-mail server, such as the depicted public server 92 of 
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Fig. 9. However, using the ISP message server offers additional benefits. In one 
embodiment, an ISP message preprocessor, an agent working in cooperation with the 
message server, can examine each incoming message and modify the message on 
behalf of the customer. For example, based on a customer's preferences, such a 
5 message preprocessor may replace a large audio file attachment with HTML 
streaming controls to reduce the time it takes to download the message. 

With reference again to Fig. 2, the ISP 15 can also support an extensible set 
of Information servers 32 on which customers can store various types of personal 
information, such as address books and calendars. Along with the profile and 

10 mailbox, this information helps the ISP 15 to establish a network-based "presence" 

for each customer, allowing a service developer to create more personalized services. 
In one embodiment depicted in Fig. 10, an Application Configuration Access 
Protocol (ACAP) server can support address books, while a Lightweight Directory 
Access Protocol (LDAP) server can support larger directories. Other optional 

15 servers can include a certificate server to support digital signatures. For each such 
Information server 32, an API can be defined and used by service developers on the 
application server. The APIs are defined to reduce or eliminate dependency on a 
particular standard within a service. For example, the Address Book Interface may 
define abstractions that can be implemented using either ACAP or LDAP. 

20 As seen from the above description, the ISP application server 15 supports a 

class of integrated communication/information services that customers can access 
whenever, and wherever they choose. A service executing on behalf of a specific 
customer operates within the context of a customer session, called an ISP 
application. Each ISP application can be composed of a set of inter-connected 

25 objects derived from an ISP application model. As discussed above, the ISP 
application model can be an object-oriented framework that supports the 
development of configurable, customizable services that include built-in support for 
certain service design goals, including CPE- and Network-Independence. 

Fig. 12 depicts more specifically the components that make up an application 

30 for providing communication services to a customer. Specifically, Fig. 12 depicts a 
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model for an application model that includes a session object 100, a plurality of 
service objects 102A-102E and a profile object 104. These objects cooperate to 
implement a service. 

The session object 100 represents a "context" within which all work in the 
5 form of a Service takes place on behalf of a specific customer. To this end, the 
session object 100 can store information representative of the state of the 
communications events associated with a particular customer. A session object 100 
is associated with exactly one customer and is responsible for managing that 
customer's executing services. The application server can allow only one session 

10 object 100 per customer to exist at any given time. However, there may be more than 
one service executing simultaneously within that session object 100. Because of this, 
the session object 100 can also be responsible for managing any shared objects 
needed to coordinate the activities of related services, such as the Communications 
Infrastructure described below that stores the "call state" information used by the 

15 integrated set of communications services defined within the ISP. The state 

information maintained by the session object 100 can include any information that a 
service may be interested in knowing. For example, the state information can 
include information that describes each structure that is presently supporting a 
communications event in which the customer is participating. This can include 

20 information regarding the call management infrastructure, including the control leg 
information, which is described in detail hereinafter. State information can also 
include a list of the services that are currently running, the endpoint devices 
available to a customer, a bulletin board space that can carry information of interest 
to any party, and to which different parties can post information for other services 

25 and parties to see and consider, and a cache memory that allows a session object to 
cache information that a service may want to access subsequently. Additionally, the 
state information can include customer preferences as to how communications 
events are to be handled, and other information that the customer can edit from time 
to time. 
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The service objects 102A-102E represent an action or task being performed 
on behalf of the customer. Each service object 102A-102E is designed either to be 
an interactive service to interact directly with the customer or an agent service to 
perform a task on his/her behalf autonomously. All services, whether interactive or 
5 an agent, are derived from a base service class. An interactive service is one that is 
driven by the customer directly through a user interface (e.g., an IVR service) and, 
therefore, requires that the customer be logged in, or connected, to the session object 
100. An agent service can be a self-contained task that is driven by a set of 
pre-defined preferences/parameters and does not require direct interaction with the 

10 customer, although an agent may choose to interact with the customer if the 

customer happens to be connected. An agent can be initiated at any time, typically 
in response to an event, regardless of whether the customer is connected. 

The profile object 104 supplies personal information/preferences to the 
session 100 and service 102 objects and is used to modify or customize their 

15 behavior. The information can be stored as an extensible list of named attributes, or 
fields. The value of a field may be visible to any customer or held private and visible 
only to this customer. For example, a customer's e-mail account may be public and, 
therefore, used by other customers to send a message, while the account password 
may remain private. 

20 The ISP 15 can support unified communications in which services/agents 

present a single, integrated view of the state of a customer's communications. To 
this end, the application model can define a set of interconnected components, 
collectively referred to as the Communications Infrastructure, that represent this 
integrated view. Using the resources defined by the MS CI 40, the Communications 

25 Infrastructure manages the calls associated with a particular customer. Because these 
resources represent the customer's view of his/her calls, and not the "global" view of 
all the participants, as might be maintained by a media server, it can be understood 
as a half-call model. Because it represents information that is shared among a set of 
integrated services for a customer, the Communications Infrastructure is managed by 

30 the session object 100. In one embodiment, the Communications Infrastructure is 
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made up of two primary objects as well as several agents that perform specific 
functions and help customize the way calls are managed on behalf of a customer. 
Such infrastructure is depicted in Fig. 1 1, which shows an infrastructure 1 10 formed 
of a control leg object 1 12 and a call management object 1 14. Additionally, Fig. 14 
5 depicts one relationship between the session object 100 and the control object 1 12 
and the call management object 1 14. 

The control leg object 112 represents the multimedia pathway, or bearer 
channel, to the customer. For each media required, the control leg 1 12 allocates and 
manages an MSCI call resource to establish a media pathway to a device/destination 

10 specified by the customer. The set of call resources act as a "virtual" multimedia 

communications terminal, since the individual media streams to the customer do not 
have to terminate at the same physical device. For example, the customer can 
establish a multimedia call by using a phone for audio while using a PC for video. 
The customer can also redirect a particular media stream of the control leg 1 12 to a 

15 different device at any time without affecting an active call. For example, if the 

audio quality of an IP telephony client begins to degrade during a call, the customer 
can redirect the audio portion of the control leg 1 12 to a nearby phone. 

The call management object 1 14 represents the set of incoming/outgoing 
calls to which a customer has access at any given time. Like the control leg 1 12, each 

20 call maintained by the call management object 1 14 consists of a set of call resources, 
each of which can correspond to a different media type. Each call object can be in 
one of the three states defined by the call management object 1 14: Setup, Active, or 
Message. A customer can have multiple calls in any of the three states. 

A call in the Setup state can be an incoming call whose disposition (i.e., 

25 whether it will be accepted and in which of the other states it will be placed) has not 
yet been decided. 

• A call in the Active state can correspond to an individual with whom the 
customer wishes to actively communicate. Typically, the set of calls in the 
30 Active state are being controlled through an interactive service, such as a 
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Java-based ISP call manager applet, the visual interface to the 
communications infrastructure that allows the customer to 
add/drop/select/conference the individuals with whom the customer wishes to 
interact. Fig. 1 1 depicts a set of Active calls in which one call has been 
5 selected by the customer (i.e., to which the control leg object 1 12 is 

connected), while the remaining calls are left on hold. 



• A call in the message state can be a call that has been sent to a network-based 

answering machine, similar to a voice mail system, to allow the caller to leave 
10 a multimedia message for the customer. Additionally, the customer can 

screen the call by connecting the control leg object 1 12 and/or pickup the call 
by moving the call to the Active state. 



In addition to the control leg 1 12 and call management 1 14 objects, the 

15 Communications Infrastructure can include a set of agents. An incoming call agent 
can be created in response to an event generated when a call arrives for the customer. 
Based on preferences in the profile object 104, personal information (e.g., 
calendar/datebook) and other variables (e.g., Caller ID, time of day), the incoming 
call agent can decide whether the call should be placed under call management (as 

20 an Active call or a message call), transferred to another destination, or 

rejected/blocked. If a customer happens to be logged in, the agent can also query the 
customer directly to determine the disposition of the call. 

A call recorder agent can be created in response to a call being placed in the 
message state under call management. After allocating the necessary recorder 

25 resources and connecting them to the media streams of the call, the call recorder 
agent can play a pre-recorded prompt, record the media streams until the call ends 
(or the agent is terminated), and then package the recorded media files into an e-mail 
message that is sent to the customer's mailbox for later retrieval/playback. As a result 
of its flexible design, this agent can also be used to record calls/conferences in the 

30 Active state. For example, using the ISP call manager, the customer drags an icon 
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representing a call recorder agent onto an icon representing an active call/conference 
to begin recording the conversation. 

Additionally, a media translation agent can be provided to support 
cross-media translation using the MSCI converter resources. Like the call recorder 
5 agent, this agent can be attached to a call and is designed to convert its media into a 
different form. For example, the media translation agent can be used to convert an 
incoming chat call into an audio call so that the customer can receive the call on a 
phone if so desired. In the future, the agent could be used to create a running 
transcript and/or "subtitles" for an audio/video call. More importantly, the media 

10 translation agent acts as a general model for enabling more advanced 

transformations, such as real-time language conversion (e.g., English-Spanish). 

In a further embodiment, the systems described herein can provide interactive 
services that are processes that interact directly with a customer through the use of a 
defined user interface. Such interactive services employ a bi-directional channel over 

15 which the interaction between the customer and the service can take place. In one 
practice, the processes employ two types of channels within the ISP 15: a voice 
channel and a data channel. The voice channel can correspond to an audio pathway 
from a customer's phone (or possibly IP telephony client) to a voice resource used by 
the service to provide IVR-style interactions. Such a service can, inter alia, play a 

20 menu prompt, collect a DTMF/spoken response and perform the selected action. 

The data channel can correspond to an IP socket connection between a desktop client 
and a service. The desktop client and the service can interact by sending requests 
back and forth over the socket connection using an agreed upon data protocol. 

In general, a developer will build a service using one of these channels. As a 

25 result, each interactive service on the ISP can be classified as either a voice service 
or a Data service. A simple depiction of these two service types, and their 
corresponding channels, are shown in Fig. 13. The relationship between a 
connection object, channel object and session object is depicted in Fig. 14. 

To execute an interactive service, a customer, can login to establish an 

30 authenticated "link" to his/her session object 100. Within the ISP application model, 



WO 01/15423 



PCT/US00/23280 



21 

a connection object 120 can represent the fact that the customer has logged in. When 
a customer logs in, a connection is created and associated with his/her session object 
100. Just as there is one active session per customer, there can be one active 
connection per session object 100 . The way in which a customer logs in can 
5 determine the type of channels that are available and, thus, the type of interactive 

services that he/she can execute. Therefore, each connection type can be responsible 
for managing/establishing the channel(s) between the customer and his/her 
interactive services. For example, the ISP can define two connection types 
corresponding directly to the channel types: a voice connection to support voice 

10 services and a data connection to support data services. Optionally, a connection 
type could be defined to support simultaneous voice and data services. 

The voice connection can be responsible for providing a voice channel to 
each voice service as it is created. Each voice channel can employ a pair of audio 
resources, a call resource connected to a voice resource, to enable a voice service to 

15 perform IVR operations. The voice connection can be responsible for allocating and 
managing these resources, which are shared by the voice channels. The voice 
channel can employ a locking mechanism defined in the voice connection to ensure 
that only one voice service is actively using these resources at any given time. 

The data connection is responsible for providing a data channel to each data 

20 service as it is created. Each data channel represents a socket connection over which 
the data service can read/write protocol messages from/to a desktop client. Since 
each socket connection is associated with a single service, the data connection does 
not have to provide a mechanism for sharing socket connections. Therefore, the data 
connection can support multiple active data services simultaneously. For example, a 

25 customer can use a web browser to run the HTML-based directory service while 
using the ISP call manager (and its corresponding service) to manage his/her calls. 

An interactive service can use either a voice channel or data channel and, 
therefore, may be dependent on the connection type. However, in optional 
embodiments, the services can be independent of the connection type. Consider the 

30 case of an incoming call agent that decides, optionally, to interact with a customer 
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who happens to be logged in to determine whether or not he/she wishes to accept an 
incoming call. Rather than force the developer to write additional code that is 
conditional on the connection type, or develop both a voice and data version of the 
same service, it is better to delegate the decision on how to query the customer to the 
5 connection. In this way, the service developer can create a single service that is 
interactive, but independent of the current connection type. 

To support this, the connection object can define a set of general dialog 
methods to send query, notification and update messages to the customer. To 
receive such messages, the customer initiates an interactive service that registers 

10 itself as a "message handler" for the connection. Whenever one of the dialog 

methods is called, the connection passes the message to the registered service, which 
then decides how to present it to the customer. For example, when the ISP call 
manager is started, its corresponding service registers itself as a message handler 
with the data connection in order to receive queries, notifications and call state 

15 updates from the objects/agents of the communications Infrastructure. The service 
can encode each message using a predefined data protocol and send it over its data 
channel to the ISP call manager, where the encoded message can be presented to the 
customer using its graphical user interface. 

In further alternative embodiments, the systems described herein can employ 

20 agents. An agent is generally understood as a service that can perform its task based 
on pre-defined preferences/parameters without interacting with the customer. An 
agent service is typically created in response to an event, or external trigger, and is 
designed to process that event in a personalized way on behalf of a customer. 
Optionally, a number of mechanisms can trigger an agent. For example, when 

25 someone calls an ISP customer, an event can be generated that triggers the creation 
of an incoming call agent to decide the disposition of the call. In addition to agents 
associated with the Communications Infrastructure, agents can also be employed to 
support and work with messaging. For example, there can be an agent, the 
Incoming message agent, for processing incoming messages. The incoming message 

30 agent examines e-mail messages before they are placed in the customer's ISP 
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mailbox and optionally modifies a message based on the customer's preferences. The 
agent can remove/replace message body parts and/or insert new body parts. For 
example, the Incoming message agent might replace large media file attachments 
with HTML-based streaming controls and/or insert targeted advertisements. The 
5 incoming message agent can also be used to filter/block unwanted messages. The 
incoming message agent, in one alternative embodiment, is meant to "preprocess" an 
e-mail message based on the customers preferences before placing it into his/her 
customer's mailbox. To this end, the agent is to act as a filter between the local 
message transfer process, such as sendmail, and the local mailbox access process, 

10 applying transformations to and emitting a message stream with MIME compliant 
bodies. The incoming message agent can be implemented as a filter program, called 
the message preprocessor, that plays the role of the incoming message agent. 

When a message is placed in an ISP mailbox, an event can be generated that 
initiates the message alert agent. This agent can determine whether or not the 

15 customer should be informed of the new message and decides how the customer 
should be notified (e.g., paging the customer, popping up a dialog box, etc.). In 
addition, the message alert agent may redirect messages from the ISP mailbox to an 
external mailbox specified by the customer. In one practice, a message generated by 
any other ISP service is always sent first to the ISP mailbox to allow the incoming 

20 message agent to process it and to enable the message alert agent to send a 
notification and/or redirect it to the mailbox preferred by the customer. 

In one alternative embodiment, the systems described herein extend the role 
of e-mail from message delivery to service activation. The Service Activation 
Message (SAM) infrastructure, an extension of the ISP message server, allows a 

25 remote customer to initiate an agent service by sending an e-mail message to the ISP. 
For example, suppose that a customer needs to call a large group of people to 
deliver the same message (e.g., "soccer practice has been canceled"). By sending 
e-mail to broadcast@gte.com, the ISP will initiate a Broadcast agent on behalf of the 
customer to deliver the message to the specified recipients and report back when 

30 finished. This is just one example of many possible SAM agents, and other such 
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SAM agents can be developed by those of ordinary skill in the art, and such agents 
will be understood to fall within the scope of the invention. 

Each ISP application, such as those described above, can be constructed 
using a framework of objects defined as described with reference to Fig. 12. A basic 
5 ISP application can consist of a Session and a Profile and typically has at least one 
active service. A service can use the control leg object and 1 12 and call management 
object 1 14 to control the customer's communications. When a customer is actively 
connected to the ISP, a connection object can be created and an appropriate channel 
provided to allow a service to interact with the customer. In Fig. 14, there is 

10 depicted basic object interconnections of one ISP application framework, suitable for 
practice with the systems described herein. Although not depicted here, each service 
also has access to the APIs provided by the media servers 34, message servers 30 
and Information servers 32. 

More specifically, Fig. 14 depicts an ISP application that is being employed 

15 for allowing a customer to handle a communications event according to the 

preferences of that customer. As discussed above, the system 12 includes an ISP 
application 15 that interfaces with one or more media servers, such as the depicted 
collection of media servers 18. The media servers 18, at the direction of the ISP 15, 
arrange the communication devices available to the customer into a pathway that 

20 will support the communications event at hand. As also discussed above, a session 
object 100 can be created for each customer serviced by the ISP 15. Fig. 15 depicts 
one process 140 for creating a session object 100 for a customer and for configuring 
an ISP, such as the ISP 15 depicted in Fig. 14. Specifically, the process 140 depicts 
a first step 142 wherein an ISP waits for the detection of an incoming 

25 communications event. As described above, an event manager can be configured to 
detect an incoming event, such as an incoming real time communications event like 
an IP multimedia call. The communications manager can generate an event signal 
that directs the ISP 15 to determine whether there is a session object in existence for 
the customer associated with the event. Continuing with the above example, the 

30 process 140, upon detection of an event, would proceed to step 144 to determine 
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whether there is an existing session object for the customer associated with the IP 
multimedia call. As shown in Fig. 15, if a session object is presently instantiated for 
that customer, the process 140 can proceed to step 148. Alternatively, if no session 
object is presently created, the process 140 proceeds to step 146 wherein a session 
5 object for the customer being called is instantiated. A profile object, including the 
preferences of that customer, can also be instantiated at this time. Upon establishing 
the presence of a session object for the customer associated with the 
communications event, the process 140 proceeds to step 148 wherein the 
information contained within or managed by the instantiated session object, which 

10 can include information as to how a customer wishes to handle a communications 
event, is processed to determine the type of service that should be activated. In the 
present example, the state information associated with the instantiated session object 
can be processed to determine which service the customer wishes to employ to 
handle incoming IP multimedia calls. In response to this state information, the 

15 process 140 in step 148 can instantiate the service object desired by the customer. 
To support the instantiated service object, the process 140 can proceed to step 150 
wherein the communication infrastructure, including the control leg object 112 and 
the call management object 1 14 are instantiated. As described above, the control leg 
object 112 allocates and manages call resources, such as those provided through the 

20 MSCI, to establish a multimedia pathway to the devices specified by the customer. 
The created pathway can then be employed to support the communications event, 
until such time that the customer wishes to reset the control leg, or the call 
terminators. 

Fig. 14 depicts the set of devices that the customer, for this example, wishes 
25 to employ for supporting an incoming multimedia IP phone call. Specifically, Fig. 
14 depicts that the customer wishes to receive the video stream of the event on the 
terminal 50 and the audio stream of the event on the handset 48. To this end, the 
process 140, in step 150, can provide a communication infrastructure, including the 
depicted control leg object 1 12 and call management object 1 14 to create a 
30 multimedia pathway that will support the incoming call as desired by the customer. 
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For example, as depicted in Fig. 14, the control leg object 1 12 can employ the 
resource objects provided by the media servers 18 and described above, to create a 
logical coupling between the incoming multimedia IP phone call and the end points 
desired by the customer. Again as described above, the media servers 18 can 
5 perform the physical mapping between the logical resources of the media servers and 
the communication devices that will support the communications event. For 
example, as depicted in Fig. 14, the media servers 18 can provide a physical 
mapping that employs an PSTN/IP gateway 58, as well as other devices, to direct a 
video stream to the customer's workstation 50 and an audio stream to the customer's 
10 handset 48. Once configured, the pathway can support the communications event, 
until the customer wishes to change the pathway, or to terminate the communication 
event. 
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Claims: 

1 . A method for allowing a customer to control their participation in a 
communications event, comprising the steps of 
5 identifying a communications event associated with the customer, 

providing for that customer a session object capable of maintaining state 
information representative of status of communications events associated with that 
customer, and 

providing a plurality of service objects each capable of providing a 
10 communications service for supporting a communications event, and each service 

object being responsive to the state information maintained within the session object, 
said session object operating as a control point for said service objects, allowing the 
customer to selectively configure support for a communications event. 

15 2. A method according to claim 1, comprising the further step of 

providing a customer profile object having information representative 
of characteristics associated with a respective customer, including information 
representative of customer preferences capable of modifying behavior of said service 
objects. 

20 

3. A method according to claim 1 , comprising the further step of allowing said 
session object to store control information representative of information 
provided by the customer for controlling the behavior of a service object. 

25 4. A method according to claim 1, wherein said state information includes 

information for modifying behavior of two or more service objects to provide 
coordinated operation of said service objects. 

5. A method according to claim 1 , including the further step of 
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providing a communications infrastructure for mapping 
communications events associated with said customer to a communications structure 
capable of supporting the communications event. 



5 6. A method according to claim 5, wherein providing said communications 
structure comprises providing an endpoint device capable of processing 
communication information associated with said communications event. 



7. A method according to claim 6, wherein providing said endpoint device 
10 comprises providing a hardware device. 

8. A method according to claim 6, wherein providing said endpoint device 
comprises providing a device selected from the group consisting of a 
telephone handset, wireless phones, personal digital assistants, set top boxes, 

15 personal computers, pagers, facsimile machines, Internet appliances, and 

Java telephones. 



9. A method according to claim 6, wherein providing said endpoint device 
comprises providing a software device. 

20 

10. A method according to claim 6, wherein providing said endpoint device 
comprises providing a device selected from the group consisting of IP 
telephony clients, desktop conferencing clients, email clients, browser 
programs, and personal information management clients including 

25 calendaring programs, address book programs and directories. 



11. A method according to claim 5, including the further step of 

providing a media server having a plurality of resource objects, each 
being capable of allowing the service object to control a communication device 
30 capable of supporting the communications events. 
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12. A method according to claim 5, wherein the step of providing a 
communications infrastructure includes the steps of 

providing a control leg object for mapping a real-time 
5 communications event to a set of resource objects that control a communication 
device that can provide a media pathway for coupling the customer to the real-time 
communications event. 

13.. A method according to claim 12, wherein the step of providing a control leg 
10 object for mapping a real time communications event to a set of resource 

objects, includes the step of 

accessing a set of resource objects for controlling a communications 
device that provides a multimedia pathway for coupling the customer to the real-time 
communications event. 

15 

14. A method according to claim 12, wherein the step of providing a control leg 
object includes the step of 

processing said state information to identify a set of resource objects 
that map a real time communications event to a communication device selected by 
20 the customer. 

15. A method according to claims 1 or 12, including the further step of 

allowing the customer to adjust the state information to dynamically 
alter hardware devices employed by the resource objects for supporting the call, 
25 thereby providing endpoint independent call handling. 

16. A method according to claim 5, wherein the step of providing a 
communications infrastructure includes the step of 
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providing a call management object for mapping a real-time 
communications event to a set of resource objects capable of offering the real time 
communications event as a member of a set of such events available to the customer. 

5 17. A method according to claim 5, including the step of 

providing an incoming call agent capable of processing the state 
information for determining whether to place the incoming call under call 
management. 

10 18. A method according to claim 5, including the step of 

providing an incoming call agent capable of processing the state 
information to determine whether to place an incoming call in an active state 
representative of connecting the incoming call to an endpoint. 

15 19. A method according to claim 5, including the step of 

providing an incoming call agent capable of processing the state 
information to determine whether to place an incoming call in a messaging state 
representative of connecting the incoming call to a messaging client capable of 
generating a message representative of the incoming call. 

20 

20. A method according to claim 5, including the step of 

providing an incoming call agent capable of processing the state 
information for determining an action for processing an incoming call, wherein the 
action includes at least one of transferring the call to a predetermined location, 
25 sending the call to another customer, blocking the call, and querying the customer 
for information for further processing the call. 

21. A method according to claim 5, wherein the step of providing a 
communications infrastructure includes the step of 
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providing a call recorder agent capable of capturing a media stream 
associated with the call and of packaging the resulting media file into an e-mail 
message for delivery to a mailbox associated with the customer. 



5 22. A method according to claim 5, wherein the step of providing a 
communications infrastructure includes the step of providing 

media translation agent capable of supporting real-time cross-media 
translation to translate a media stream associated with a call from a first format to a 
second format. 

0 

23. A method according to claim 1, including the further step of 

allowing the customer to login and thereby create a connection object 
capable of allowing the customer to interact with said session object. 



15 24. A method according to claim 23, including the further step of creating a 

connection object that provides a channel object capable of acting as a media 
pathway between an endpoint employed by the customer and the service 
object. 

20 25. A method according to claim 1, including the step of 

creating a session object responsive to the identification of a communications 

event. 



26. A method according to claim 25, wherein creating a session object occurs in 
25 response to detecting initiation of a communications event associated with 

the customer. 



27. A method according to claim 25, wherein creating a session object occurs in 
response to detecting an incoming message for the customer. 



30 
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28. A system for allowing a customer to control their participation in a 
communications event, comprising 

state management means, associated with the customer, and being 
capable of maintaining state information representative of each communications 
5 events associated with the customer, 

service means for supporting a communications event, and being 
responsive to the state information maintained by the state management means, and 

means for allowing the customer to adjust the state information for 
selectively configuring support for a communications event. 

10 

29. A system according to claim 28, further comprising media server means for 
providing a plurality of resource objects capable of controlling a set of 
communication devices associated with the customer. 

15 30. A system according to claim 29, further comprising control leg means for 
mapping a real-time communications event to a set of the resource objects to 
provide a media pathway for coupling the customer to the communications 
event. 

31. A system according to claim 28, wherein said means for allowing a customer 
to adjust state information comprises, 

a graphical user interface for presenting the customer with graphical 
icons that can be manipulated to selectively adjust the support for the 
communications event. 

32. A system for allowing a customer to control their participation in a 
communications event, comprising 

a service platform capable of detecting a communications event 
associated with the customer and capable of generating a session object for the 
customer in response to a detected communications event, 
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a session object, associated with the customer, and capable of 



managing state information representative of status of communications events 
associated with the customer, and capable of generating a service object for 
supporting a communications event associated with the customer, and 



5 



a service object, responsive to the state information maintained by the 
session object, and capable of providing a communications service for a 



communications event associated with the customer. 



10 



33. 



A system according to claim 32, further comprising 

a profile object, having information representative of characteristics 



associated with a respective customer, including information representative of 
customer preferences capable of modifying behavior of the service object. 

34. A computer readable medium containing instructions for causing at least one 
15 processor to perform a method for permitting a customer to control a 

communications event, the method comprising: 

detecting at least one communications event associated with the customer; 

generating a session object for the customer in response to the detected 
communications events; 
20 maintaining state information representative of a status of the 

communications events; 

generating a plurality of service objects that provide a communications 
service relating to each of the communications events; and 

permitting the customer to control the communications events using the 
25 session object and corresponding ones of the service objects. 

35. A memory containing a data structure, comprising: 

a session object configured to store instructions for managing at least one 
communications event associated with a customer and for maintaining state 
30 information representative of a status of the at least one communications event; and 
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at least one service object configured to store instructions for performing a 
task relating to the at least one communications event under control of the session 
object. 

5 36. The memory of claim 35, wherein the at least one service object includes at 
least one of an interactive service object and an agent service object. 

37. The memory of claim 36, wherein the interactive service object is configured 
to interact directly with the customer to perform a task. 

10 

38. The memory of claim 36, wherein the agent service object is configured to 
perform a task for the customer based on predefined preferences or parameters. 

39. The memory of claim 35, further comprising: 

15 a profile object configured to store preferences relating to the customer and 

instructions for modifying operation of the at least one service object based on the 
stored customer preferences. 

40. A personal messaging agent, comprising: 

20 a call receiver configured to receive an incoming call directed to a customer; 

a call router configured to determine a location to which to route the 
incoming call based on preferences of the customer; 

a call recorder configured to record the incoming call as a recorded message 
and package the recorded message for delivery to the customer; and 
25 a media translator configured to translate the incoming call from a received 

format to a delivery format. 



30 



41. The personal messaging agent of claim 40, wherein the call router is 
configured to route the incoming call to one of an answering service and a location 
of the customer. 
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42. The personal messaging agent of claim 40. wherein the call router is further 
configured to determine whether to reject the incoming call based on the customer 
preferences. 

5 

43. The personal messaging agent of claim 40, wherein the call recorder is 
configured to package the recorded message as an email message and deliver the 
email message to the customer. 

10 44. The personal messaging agent of claim 40. wherein the call recorder is 

configured to provide streaming controls for playback of the recorded message by 
the customer. 

45. The personal messaging agent of claim 40, wherein the call recorder is 
15 further configured to record an active call of the customer. 

46. The personal messaging agent of claim 40, wherein the media translator is 
configured to convert a media type of the incoming call for delivery to the customer. 

20 47. The personal messaging agent of claim 40. wherein the media translator is 
configured to covert a language type of the incoming call for delivery to the 
customer. 

48. The personal messaging agent of claim 47, wherein the media translator is 
25 configured to convert the language type of the incoming call in real time. 
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